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HIGHLIGHTS 


•  We  discuss  DP,  PMP,  and  ECMS  in  presence  of  state  inequality  constraints. 

•  We  use  DP  solution  for  extracting  optimal  equivalent  factor  trajectory. 

•  Equivalent  factor  must  be  adjusted  drastically  if  state  constraints  are  active. 

•  Equivalent  factor  adaptation  prevents  loss  of  recuperation  energy  under  downhill  road. 
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Among  existing  energy  management  strategies  (EMSs)  for  fuel  cell  hybrid  electric  vehicles  (FCHEV),  the 
equivalent  consumption  minimization  strategy  (ECMS)  is  often  considered  as  a  practical  approach 
because  it  can  be  implemented  in  real-time,  while  achieving  near-optimal  performance.  However,  under 
real-world  driving  conditions  with  uncertainties  such  as  hilly  roads,  both  near-optimality  and  charge- 
sustenance  of  ECMS  are  not  guaranteed  unless  the  equivalent  factor  (EF)  is  optimally  adjusted  in  real¬ 
time.  In  this  paper,  a  methodology  of  extracting  the  globally  optimal  EF  trajectory  from  dynamic  pro¬ 
gramming  (DP)  solution  is  proposed  for  the  design  of  EF  adaptation  strategies.  In  order  to  illustrate  the 
performance  and  process  of  the  extraction  method,  a  FCHEV  energy  management  problem  under  hilly 
road  conditions  is  investigated  as  a  case  study.  The  main  goal  is  to  learn  how  EF  should  be  adjusted  and 
the  impact  of  EF  adaptation  on  fuel  economy  under  several  hilly  road  cases.  Using  the  extraction  method, 
the  DP-based  EF  is  computed,  and  its  performance  is  compared  with  those  of  Pontryagin's  minimum 
principle  (PMP)  and  conventional  ECMS.  The  results  show  that  the  optimal  EF  adaptation  significantly 
improves  fuel  economy  when  the  battery  SoC  constraint  becomes  active,  and  thus  EF  must  be  properly 
adjusted  under  severely  hilly  road  conditions. 

©  2014  Elsevier  B.V.  All  rights  reserved. 


1.  Introduction 

Fuel  cell  technology  is  one  of  the  promising  long-term  energy 
solutions  for  future  transportation  systems  because  it  can  eliminate 
tail-pipe  C02  emissions  as  well  as  other  harmful  emissions. 
Generally,  fuel  cell-powered  vehicles  are  equipped  with  an  energy 
storage  system  and  are  often  called  fuel  cell  hybrid  electric  vehicle 
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(FCHEV)  because  the  addition  of  an  energy  storage  system  creates 
an  additional  degree  of  freedom  in  power  flow.  This  allows  the  fuel 
cell  system  to  operate  more  reliably  and  efficiently.  For  harnessing 
the  full  potential  of  FCHEVs,  power  coordination  between  the  two 
energy  sources,  known  as  energy  management  strategy  (EMS),  is 
very  important,  and  the  optimal  EMS  has  been  studied  widely  over 
the  past  decade. 

Existing  EMSs  can  be  classified  into  three  types:  rule-based 
approach,  horizon  optimization  approach,  and  instantaneous 
(real-time)  optimization  approach.  Rule-based  approaches  use  a 
deterministic  rule  or  a  fuzzy  set  of  rules,  designed  heuristically 
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Nomenclature 

BT 

battery 

DP 

dynamic  programming 

ECMS 

equivalent  consumption  minimization  strategy 

EF 

equivalent  factor 

EMS 

energy  management  strategy 

FC 

fuel  cell 

FCHEV 

fuel  cell  hybrid  electric  vehicle 

GPS 

global  positioning  system 

HEV 

hybrid  electric  vehicle 

HJB 

Hamiltonian  Jacobi  Bellman 

PMP 

Pontryagin's  minimum  principle 

SoC 

state  of  charge  in  battery  system 

based  on  the  efficiency  of  each  power  source  1,2  .  Other  recent 
studies  attempt  to  optimize  the  performance  of  rule-based  con¬ 
trollers  by  calibrating  control  parameters  and  thresholds  that 
determine  operation  mode  switching  [3,4],  but  the  optimization  of 
multiple  control  parameters  under  real-world  driving  conditions 
with  many  uncertainties  are  challenging  and  their  optimality  are 
not  guaranteed.  In  order  to  ensure  the  optimality,  horizon  optimi¬ 
zation  method  such  as  Dynamic  Programming  (DP)  is  widely  used 
[5,6  .  However,  DP  cannot  be  implemented  as  a  real-time  controller 
because  it  requires  complete  driving  cycle  information  a  priori  and 
imposes  a  heavy  computational  burden  [7,8].  In  contrast,  instan¬ 
taneous  optimization  methods  such  as  equivalent  consumption 
minimization  strategy  (ECMS)  are  easy  to  implement,  but  their 
global  optimality  over  the  horizon  is  not  guaranteed  [9].  However, 
it  is  widely  accepted  that  ECMS  achieves  near-optimal  performance 
with  the  selection  of  an  appropriate  equivalent  factor  (EF)  10-12]. 
A  few  studies  have  proposed  a  method  for  determining  the  EF  using 
a  pattern  recognition  algorithm  for  achieving  near-optimal  per¬ 
formance  under  real-world  driving  conditions  13]. 

The  near-optimality  of  ECMS,  however,  no  longer  holds  when 
state  inequality  constraints  become  active.  For  instance,  when  un¬ 
certainties  such  as  a  hilly  road  section  are  present,  constant  EFs 
cannot  guarantee  the  charge-sustenance  and  near-optimality.  For 
solving  this  problem,  many  studies  have  proposed  adaptive-ECMS, 
wherein  the  EF  is  adjusted  based  on  the  battery  state-of-charge 
(SoC)  14,15  .  While  these  online  adaptive  ECMSs  yield  practical 
benefits  in  terms  of  charge  sustenance,  they  do  not  guarantee  near¬ 
optimality  and  even  charge-sustenance  under  active  state 
inequality  constraints.  In  Ref.  16],  a  predictive  reference  signal 
generator  was  proposed  for  generating  the  desired  battery  SoC 
trajectory,  which  helps  maximize  energy  recuperation  under  state 
inequality  constraints.  Although  this  approach  helps  recuperating  a 
greater  amount  of  braking  energy  while  maintaining  SoC  within 
the  admissible  range  as  compared  with  the  conventional  ECMS,  it 
cannot  be  considered  as  benchmark  that  guarantees  global 
optimality. 

A  practical  method  of  guaranteeing  near-optimality  would  be  to 
adjust  EF  using  the  horizon  optimization  approach.  A  means  of 
obtaining  a  good  reference  EF  trajectory  is  the  use  of  Pontryagin's 
minimum  principle  (PMP)  approach  because  the  PMP  necessary 
condition  includes  costate  dynamics,  which  essentially  represents 
the  optimal  EF  trajectory  [17,18].  In  particular,  for  HEV  applications, 
it  is  widely  accepted  that  the  PMP  solution  is  unique  and  globally 
optimal  [19  .  However,  under  active  state  inequality  constraints, 
PMP  problem  formulation  is  not  trivial,  and  the  solutions  are  no 
longer  unique.  There  have  been  attempts  to  formulate  and  solve 
PMP  problems  with  state  inequality  constraints.  For  instance,  Kim 
et  al.  used  an  optimal  control  theory  that  converts  the  state 


inequality  constraint  into  a  new  single  equality  constraint  as  a  part 
of  the  necessary  condition  [19,21  .  In  addition,  Kim  et  al.  proposed 
the  use  of  a  jump  condition,  which  allows  discontinuity  of  the 
costate  dynamics  for  plug-in  HEV  energy  management  problems 
[20].  However,  these  approaches  lead  to  multiple  local  minimum 
solutions,  and  these  solutions  do  not  guarantee  optimality  unless 
many  iterations  are  carried  out  for  determining  the  globally 
optimal  solution.  Therefore,  a  methodology  for  extracting  the 
globally  optimal  EF  trajectory  from  the  DP  solution  is  proposed, 
including  extreme  case  of  active  state  inequality  constraints.  This 
method  can  potentially  be  used  for  designing  an  adaptive  ECMS,  the 
EF  of  which  tries  to  mimic  the  EF  extracted  from  DP  solutions. 

The  main  contributions  of  this  paper  are  as  follows:  1)  The 
strengths  and  limitations  of  three  EMSs  (DP,  PMP,  and  ECMS)  under 
state  inequality  constraints  are  discussed.  2)  A  simple  but  effective 
method  is  proposed  for  extracting  the  globally  optimal  EF  trajectory 
that  preserves  the  state  inequality  constraints  from  DP  solution. 
This  method  can  provide  valuable  insights  into  how  to  adjust  EF  for 
achieving  global  optimal  performance  as  a  benchmark  for  online 
ECMS  adaptation.  3)  A  case  study  is  carried  out  for  checking  the  DP- 
based  EF  trajectory  corresponding  to  conditions  in  which  hilly  road 
conditions  activates  SoC  constraints  or  not.  The  results  show  that 
when  hilly  road  conditions  activate  SoC  constraints,  the  loss  of 
optimality  of  ECMS  is  significant,  and  thus  the  EF  must  be  adjusted 
appropriately  for  achieving  both  near-optimal  fuel  economy  and 
charge  sustenance. 

The  remainder  of  this  paper  is  organized  as  follows:  Section  2 
includes  an  introduction  to  the  FCHEV  system  configuration  and 
system  modeling.  Section  3  explains  the  horizon  optimization 
approach  under  state  inequality  constraints.  In  Section  4,  ECMS  is 
addressed  as  one  of  the  instantaneous  optimization  approaches.  In 
the  presence  of  state  inequality  constraints,  the  EF  role  of  ECMS  is 
emphasized  for  achieving  charge  sustenance  and  near-optimality. 
Therefore,  the  method  to  extract  the  optimal  EF  trajectory  from 
the  DP  solution  is  introduced.  Section  5  discusses  a  case  study  in 
which  ECMS  with  DP-based  EF  is  applied  to  a  real-world  driving 
condition.  The  results  of  the  case  study  show  that  the  DP-based  EF 
trajectory  provides  a  reference  and  valuable  insights  into  how  EF 
should  be  adjusted  under  hilly  road  conditions.  Finally,  in  Section  6, 
the  summary  and  conclusions  of  this  study  are  presented. 

2.  FCHEV  system  configuration 

In  this  section,  a  system-level  FCHEV  model  is  introduced  for 
energy  management  studies.  Fig.  1  shows  a  block  diagram  of  the 
FCHEV  model,  which  consists  of  a  fuel  cell  system,  battery  system, 
and  vehicle.  The  fuel  cell  system  acts  as  the  main  electrical  power 
source  for  the  system  bus,  and  the  electrical  power  supplied  by  the 
battery  is  determined  as  follows. 

^demand  =  ^BT-req  +  f^FCreq  0) 

This  power  bus  relationship  is  based  on  the  fact  that  the  two 
energy  sources  put  together  must  provide  the  power  required  by  a 
driving  cycle. 


p 

1  FC  auxiliary 


Fig.  1.  Block  diagram  of  FCHEV  model. 
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In  this  study,  system-level  EMS  is  chosen,  and  a  simplified 
FCHEV  model  is  used.  Furthermore,  the  efficiency  map  of  electric 
motor  and  constant  inverter  efficiency  are  included  for  calculating 
electric  power  demand  of  the  driving  cycle.  The  target  FCHEV  is  a 
sports  utility  vehicle,  and  its  specifications  are  listed  in  able  1. 


2.1.  Fuel  cell  system 


The  fuel  cell  system  is  the  main  power  source  in  FCHEVs.  It 
converts  hydrogen  into  electrical  energy  through  electrochemical 
reactions.  In  this  study,  a  quasi-static  FCHEV  model  is  used  for  the 
fuel  cell  stack,  which  is  widely  accepted  for  system-level  energy 
management  problem  formulation  [22].  The  fuel  cell  stack  voltage 
is  determined  using  a  typical  polarization  curve,  which  is  a  function 
of  current  density. 

The  fuel  cell  system  requires  auxiliary  systems  that  support  the 
fuel  cell  stack.  The  auxiliary  systems  include  a  compressor,  cooler, 
supply  manifold,  humidifier,  and  hydrogen  circuit  control  system, 
and  these  systems  consume  electric  power.  Thus,  the  fuel  cell  stack 
must  produce  extra  electric  power  for  the  auxiliary  systems,  and 
the  total  fuel  cell  stack  power  is  given  as  follows: 

^FC-  stack  =  ^FCreq  +  ^FC  •  auxiliary  (2) 

Note  that  isothermal  fuel  cell  stack  operation  is  assumed. 

If  the  required  fuel  cell  stack  power  and  fuel  cell  stack  voltage 
are  known,  fuel  cell  current  can  be  computed.  Then,  the  hydrogen 
consumption  rate  is  computed  as  follows: 


mu2 


Mh2 

neF 


where  Npc  denotes  the  number  of  cells  in  the  fuel  cell  stack,  MH2 
denotes  the  molar  mass  of  hydrogen,  ne  denotes  the  number  of 
electrons,  and  F  denotes  Faraday's  constant. 


2.2.  Battery  system 


The  battery  model  was  developed  based  on  the  simple  resistive 
equivalent  circuit  model,  where  a  voltage  source,  resistor,  and  the 
load  are  connected  in  series.  The  battery  current  is  calculated  from 
the  requested  battery  power  (PBT.req)  as  follows. 


^BT-OC  -  BT-OC  -  4'^BTint'^BTreq 


2  R 


BT-int 


where  Vbt-oc  denotes  open  circuit  voltage  and  Fbt  int  denotes  in¬ 
ternal  resistance.  Both  open  circuit  voltage  and  internal  resistance 
depend  on  the  battery  SoC.  The  Coulomb  counting  method, 
expressed  using  Eq.  5,  is  used  for  estimating  SoC. 

t 

SoC(f)  =  SoC(to)  -  rr—  f  Ibt (t)dt  (5) 

tzmax  J 
to 


where  Qmax  denotes  the  maximum  battery  capacity. 


Table  1 

Vehicle  specifications:  sports  utility  vehicle  (SUV). 


Vehicle  parameters 

Value 

Vehicle  total  mass 

1936  kg 

Front  area 

2.608  m2 

Air  drag  coefficient 

0.44 

Ambient  air  density 

1.18  kg  m-3 

Rolling  resistance  coefficient 

0.013 

2.3.  Vehicle  model 

The  force  demand  profile  of  a  given  driving  cycle  can  be  deter¬ 
mined  using  the  longitudinal  vehicle  dynamic  model,  which  is 
mainly  dependent  on  three  force  terms:  rolling  resistance,  air  drag 
resistance,  and  hill  climbing  resistance,  as  given  by  Eq.  (6). 

^demand  =  m'V  +  +  Fr  +  Fg 

1  9 

=  m-v  +  -•  pA[Y-AfCd-vz  +  Cr-m-g-c  os(a)  +  m-g- sin(a) 

(6) 

where  Fa  denotes  air  drag  resistance  force,  Fr  denotes  rolling  resis¬ 
tance  force,  and  Fg  denotes  climbing  resistance  force  due  to  gravity  on 
non-horizontal  roads,  v  denotes  vehicle  speed,  pair  denotes  ambient 
air  density,  Af  denotes  front  area,  Cd  denotes  air  drag  coefficient,  Cr 
denotes  rolling  resistance  coefficient,  m  denotes  vehicle  mass,  g  de¬ 
notes  acceleration  due  to  gravity,  and  angle  a  denotes  road  slope. 

3.  Horizon  optimization  approach  with  state  constraints 

In  this  section,  two  popular  horizon  optimization  methods,  DP 
and  PMP,  are  summarized  and  their  strengths  and  limitations  are 
discussed  under  active  state  inequality  constraints.  The  optimal 
control  problem  is  formulated  as  follows: 

h 

Minimize  J  =  /i(x(tf),ff)  +  /*(*(.),„((),„(.),.) d,  (7) 

to 

Subject  to  x(t)  =  f(x(t),  u(t),  co(t),  t)  (8) 

x(t)EX(t),u(t)eU(t)  (9) 

where  g  is  cost  function,  and  h  is  the  terminal  state  cost,  which  can 
be  used  for  enforcing  the  final  state  constraint,  x  and  u  represent 
the  state  variable  vector  and  the  control  input  vector,  respectively. 

3.1.  Dynamic  programming  (DP) 

DP  is  a  numerical  method  for  solving  multistage  decision¬ 
making  problems  based  on  Bellman's  principle  of  optimality  [5,6  . 
The  main  strength  of  DP  is  that  the  globally  optimal  solution  is 
guaranteed  even  for  nonlinear  non-convex  problems  with  state  and 
control  constraints.  However,  DP  suffers  from  heavy  computational 
load  and  cannot  be  implemented  in  real-time  controllers  because 
all  disturbances  must  be  known  a  priori  [18  .  Thus,  DP  is  often  used 
as  an  optimal  performance  benchmark  while  designing  a  subopti- 
mal  real-time  controller.  For  implementing  DP,  the  original  optimal 
control  problem  (Eqs.  (7)— (9))  is  discretized  as  follows. 

Xfc+l  =  fkfaki  ^/o  w/<) •>  k  =  0, 1 , . . . ,  Af  —  1 , 

(10) 

xk^Xk:  uk(=Uk,  o)k e Wk 

where  state  variables,  control  inputs,  and  disturbances  are  limited 
to  subsets  Xk,  Uk,  Wk,  respectively. 

Furthermore,  the  cost-to-go  function  from  state  xk  at  time  i  to 
the  final  state  xjy  at  time  N  is  defined  as  follows: 

N- 1 

Jk(Xk)  =gN(XN)  +  JJgk(Xk,Uk,0Jk)  (11) 

k=i 

where  gk  indicates  the  incremental  cost  and  gjy  denotes  the  final 
cost,  which  includes  additional  cost  of  undesired  final  states. 
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By  evaluating  the  cost-to-go  backwards  in  time,  the  optimal 
control  policy  n°  that  satisfies  the  following  can  be  found. 


where  (X/j  = 


min 

uk  *=  Uk 


(%k  ^ki  Mk )  “h Jk+ 1  ifk  (^k  >  ^/o  0Jk ))  j- 


(12) 


For  the  DP  realization  of  FCHEVs,  cost  function,  state,  and  con¬ 
trol  input  are  defined  by  fuel  consumption  (hydrogen  mass  flow 
rate),  the  battery  SoC,  and  fuel  cell  power,  respectively. 


g  =  rh h2,  u  =  P¥C.req:  x1=SoC  (13) 

Furthermore,  time  grid  is  fixed  to  Is,  SoC  grid  is  fixed  to  0.5%,  and 
^FC.req  grid  is  fixed  to  50  W.  Namely,  state  variable  SoC  is  quantized 
into  121  possible  values  with  state  inequality  constraints 
20%  <  x(/<)  <  80%,  control  input  Ppc.req  is  quantized  into  1501  possible 
values  with  control  input  inequality  constraints  0  <  u(k)  <  75  kW.  For 
a  more  detailed  description  of  the  DP  algorithm,  see  Ref.  23]. 


The  necessary  conditions  considering  state  constraints  can  now 
be  derived  from  the  augmented  Hamiltonian  function.  Those  that 
satisfy  Eqs.  (7)— (9)  and  Eqs.  14  and  15  are  as  follows: 


x(t)  = 


*n+l  (t)  = 


'dH„(X,U 
0X 

dH„(X,U,M,\,t) 


0^n+l 


=  f(X,U,W,t) 


=  /„+1(X.U.<,,;tj 


(17) 


X(t)  =  - 


7n+l (0 


'9 H„(x,  U 

ax 

'6f(x,u,  (o,  ty 

dx 

<)Hn(X,  U 


9^(x,  U,  to,  f) 

ax 


ax 


o 


n+1 


(18) 


3.2.  Pontryagin's  minimum  principle  (PMP) 

PMP  is  another  horizon  optimization  method  that  was  devel¬ 
oped  based  on  the  calculus  of  variations.  PMP  solves  the  optimal 
control  problem  analytically  with  a  considerably  lower  computa¬ 
tional  burden  and  is  often  considered  as  a  DP  alternative  19]. 
Although  there  may  exist  multiple  local  minimum  solutions  in  the 
PMP  approach,  there  exists  a  unique  globally  optimal  solution  for 
convex  problems  19].  Furthermore,  PMP  can  be  derived  from  DP  in 
continuous  time  under  no  state  constraints  (See  Appendix).  How¬ 
ever,  the  handling  of  state  inequality  constraints  within  PMP  is 
nontrivial.  In  this  section,  a  simple  method  that  can  handle  state 
inequality  constraints  as  a  part  of  the  necessary  conditions  is 
introduced.  This  method  converts  all  state  inequality  constraints 
into  a  single  equality  constraint  by  defining  a  new  variable;  then, 
the  Hamiltonian  function  is  augmented  with  this  equality 
constraint  [19,21  .  If  the  number  of  state  inequality  constraints  is  /, 
ith  state  inequality  constraint  is  described  in  following  form: 

hj(x(t),t)>  0,  i  =  1,2,/  (14) 

where  h  indicates  each  state  inequality  constraint  defined  by  a 
function  of  state  and  time,  and  it  has  continuous  first  and  second 
partial  derivatives  with  respect  to  x(t). 

For  handling  l  state  inequality  constraints  together,  a  single 
equality  constraint  is  newly  defined  as  a  new  dynamic  state  vari¬ 
able  xn+i,  as  follows: 


=*„+i(t)  =  ^[h,-(x(t),t)]2-0( 


1=1 


where  6 {-hi) 


0,  hi  >  0 

1,  hi<0 


(15) 


where  0  denotes  the  Heaviside  step  function. 

The  new  equality  constraint/n+i  is  non-negative  at  all  times  and 
equals  to  zero  only  if  all  state  inequality  constraints  are  inactive.  In 
other  words,  the  Heaviside  step  function  and  the  augmented  equality 
constraint  are  active  only  when  the  state  inequality  constraints  are 
active.  The  Hamiltonian  function  is  augmented  by  the  additional 
equality  constraint  with  a  new  Lagrange  multiplier,  as  expressed 
below: 

Hn  (X,  U,  w,  X,  t)  =g(X,U,M,t)  +lT(t)f(X,U,o>,t) 

+  •Wl  (0/n+l  (x,  U,  to,  t)  (16) 


Hn  (x* ,  u * ,  to,  X* ,  t)  <  Hn  (x* ,  u,  co,  X* ,  t)  for  all  admissible  u(t) 

(19) 

where  the  dynamics  of  the  new  Lagrange  multiplier  is  zero  because 
the  new  state  variable  xn+i(t)  does  not  explicitly  depend  on  the  new 
Hamiltonian  function.  If  the  final  states  and  the  final  time  are 
specified,  the  boundary  conditions  for  the  necessary  conditions  can 
be  expressed  as  follows: 

X*(t0)  =  X*  (tf)  =  x0,  x*+1  (to)  =  0,  x*+1  (tf)  =  0  (20) 

For  the  PMP  realization  of  FCHEVs,  the  definitions  of  cost 
function,  state,  and  control  input  are  identical  to  those  in  Section 
3.1.  State  inequality  constraints  denote  admissible  SoC  range,  thus, 
the  new  dynamic  state  variable  for  handling  state  inequality  con¬ 
straints  is  defined  by  h¥  /12  as  follows: 

f2=x2  =  hJ-6{-hi)  +  ti%-6{-h2) 

where  h-l=x-l-  xmin  >0,  h2  =  xmax  -  *i  >  0  (21 ) 

where  hi  represents  the  minimum  SoC  bound,  and  /12  represents 
maximum  SoC  bound. 

A  new  Lagrange  multiplier  h.  is  employed  to  augment  Hamil¬ 
tonian  function  with  new  dynamic  state  variable  as  follows: 

Hn  =  mH2  +  A!  •*!  +  A2  x2  (22) 

From  the  PMP  necessary  conditions,  the  dynamics  of  the  new 
Lagrange  multiplier  can  be  described  as  follows: 

A^)=-fr0  (23) 


4.  Instantaneous  optimization  approach  with  state 
constraints 

4.1.  Equivalent  consumption  minimization  strategy  (ECMS) 

In  this  section,  the  strengths  and  limitations  of  the  ECMS  are 
described.  Then,  a  simple  adaptive  ECMS  considering  state  con¬ 
straints  is  developed  as  a  baseline  real-time  controller. 
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4.2.2.  ECMS  concept:  role  of  equivalent  factor 

ECMS  is  an  instantaneous  optimization  method  that  can  be 
implemented  as  a  real-time  controller  because  its  solution  does  not 
require  future  driving  cycle  information.  It  generates  near-optimal 
performance  when  state  constraints  are  inactive.  For  FCHEVs,  the 
main  concept  of  ECMS  is  that  battery  energy  consumption  is 
considered  as  future  hydrogen  consumption,  and  the  total 
hydrogen  consumption  rate  can  be  defined  as  follows. 

s 

rheqv.  =  mH2  +  niequi.H2.5y.BT  =  mH2  +  y_[vH  ^bt  (24) 

where  rhequi  H2  .by  BT  is  the  equivalent  H2  consumption  rate  from  the 
battery,  which  can  be  obtained  by  using  EF,  s,  lower  heating  value  of 
H2,  LHVh2,  and  the  electric  battery  power,  flow  P0bt* 

For  a  given  EF  or  s,  the  optimal  power  split  ratio  between  the 
fuel  cell  system  and  battery  can  be  computed.  Then,  the  question 
becomes  how  to  find  the  optimal  EF  that  achieves  charge  suste¬ 
nance  without  violating  state  and  control  constraints.  One  method 
of  finding  the  optimal  EF  trajectory  is  using  the  PMP  approach 
because  the  costate  dynamics  of  the  necessary  condition  repre¬ 
sents  the  optimal  EF  trajectory.  When  state  constraints  are  inactive 
(i.e.,  the  battery  SoC  stays  within  the  admissible  SoC  range),  cos¬ 
tate  variation  is  relatively  small.  In  this  case,  the  PMP  solution 
approaches  ECMS  with  a  constant  EF,  and  the  near-optimal  ECMS 
performance  is  guaranteed.  This  necessitates  computation  of  the 
constant  optimal  EF  of  ECMS  that  ensures  charge  sustenance  over 
a  given  driving  cycle.  However,  when  the  state  constraints  are 
active,  the  near-optimality  of  ECMS  no  longer  holds.  In  fact,  the 
constant  EF  that  achieves  charge  sustenance  in  the  absence  of 
constraints  suffers  from  a  severe  loss  of  optimality  [16  .  Therefore, 
the  optimal  EF  must  be  adjusted  appropriately  for  achieving  near- 
optimal  performance  under  active  state  constraints.  For  instance, 
when  approaching  a  downhill  section,  the  EF  should  be  decreased 
to  promote  battery  discharge  before  said  section  arrives  for 
maximizing  the  recuperation  of  potential  energy  from  the  down¬ 
hill  section.  Moreover,  when  a  small  battery  is  used  for  cost-, 
weight-,  and  volume  reduction,  the  state  constraints  are  activated 
easily,  and,  thus,  the  role  of  EF  adaptation  gains  considerable 
importance. 


4.2.2.  ECMS  with  state  constraints 

In  this  section,  a  simple  adaptive  ECMS  that  can  avoid  the 
violation  of  state  constraints  is  introduced  as  a  baseline  real-time 
controller  (“conventional  ECMS”).  The  conventional  ECMS  pre¬ 
vents  violation  of  the  state  constraints  by  simply  adding  a  penalty 
function  to  the  constant  EF,  as  expressed  below. 

f/<p(Xmax— ^)  ^>^max 

s(t)=s+/p(t)  where,  fp(t)  =  1  0 

^min  <X<Xmax 
Up(X-*min)  X<*min 

(25) 

When  the  state  approaches  the  boundary,  the  penalty  function 
is  activated  for  preventing  the  battery  SoC  from  exceeding  the  SoC 
boundary.  More  specifically,  if  the  battery  SoC  exceeds  the 
maximum/minimum  SoC  bound,  the  penalty  function  decreases/ 
increases  EF  to  promote  battery  discharging/charging.  In  addition, 
when  the  SoC  reaches  the  maximum  SoC  bound  during  braking, 
conventional  mechanical  braking  is  used  instead  of  regenerative 
braking  for  preventing  overcharging.  Again,  the  reference  EF  value 
that  ensures  charge  sustenance  still  needs  to  be  computed  through 
iterative  search. 


4.2.  DP-based  equivalent  factor  extraction  method 

In  the  literature,  DP  solution  has  been  mainly  used  in  two  ways: 
1 )  as  a  reference  for  evaluating  the  performance  limit  of  a  given 
design  or  the  degree  of  optimality  of  proposed  real-time  controllers 
and  2)  as  a  guideline  for  designing  near-optimal  rule-based  con¬ 
trollers  [24-27].  For  instance,  Kum  et  al.  proposed  a  technique  for 
extracting  implementable  control  strategies  that  can  be  embedded 
into  a  rule-based  controller  [26,27  .  The  present  study  follows  a 
similar  approach  for  extracting  optimal  EF  trajectory. 

In  this  section,  two  methodologies  of  extracting  the  optimal  EF 
trajectory  that  can  be  used  as  a  benchmark  for  designing  an  EF 
adaptation  law  are  presented;  the  first  one  is  an  analytical  approach 
based  on  solving  ECMS  optimization  problem  under  a  few  simpli¬ 
fying  assumptions,  and  the  second  one  is  a  numerical  approach 
based  on  ECMS  database.  The  main  concepts  of  both  approaches  are 
to  utilize  DP  results  for  determining  optimal  EF  that  leads  ECMS  to 
generate  the  same  DP  results.  For  the  given  battery  SoC  and  power 
demand,  there  is  a  one-to-one  relationship  between  EF  and  optimal 
fuel  cell  power  computed  by  ECMS.  Thus,  specific  EF  value  corre¬ 
sponding  to  DP  results  can  be  determined  through  inverse  opera¬ 
tion,  as  expressed  below. 

^FC  ~ /(S°C,  ^demand ?  $)  J~f  S  =  /(SoCDP,  Pdemand,  ^FCDp)  (26) 

The  proposed  method  is  a  simple,  yet  effective  tool  for  ECMS- 
based  EMS  design  because  it  provides  many  useful  insights  into 
EF  adjustment  under  real-world  driving  conditions  (e.g.,  drive 
pattern  changes  or  hill  road  approaching).  Eventually,  it  will  act  as  a 
guideline  for  engineers  designing  EF  adaptation  laws  that  can 
achieve  near-optimal  performance  while  satisfying  the  battery 
charge  sustenance  requirement. 

4.2.2.  Analytical  approach 

If  there  are  no  bounds  on  states  and  control  inputs,  PMP  can  be 
derived  from  the  Hamiltonian-Jacobi-Bellman  (HJB)  equation,  and 
thus,  the  optimal  costate  trajectory  equals  the  optimal  cost  function 
gradient,  as  described  in  the  Appendix.  However,  when  the  state 
and  control  constraints  are  present,  this  equality  no  longer  holds, 
and  the  analytical  approach  using  HJB  equation  cannot  be  used  to 
compute  the  optimal  costate  trajectory.  Therefore,  by  solving  ECMS 
optimization  problem,  derivation  of  EF  formula  that  leads  ECMS  to 
generate  DP  results  is  emphasized.  At  first,  the  fuel  cell  and  the 
battery  models  are  simplified  to  define  a  quadratic  cost  function 
because  an  optimization  problem  with  a  quadratic  cost  function  can 
be  analytically  solved.  Then,  the  necessary  and  sufficient  conditions 
for  a  minimum  are  solved  to  derive  the  analytic  expression  of 
optimal  EF  using  DP  results. 

4.2. 2. 2.  Model  simplification 
A.  Simplified  fuel  cell  model 

Assuming  that  the  fuel  cell  stack  is  not  operated  at  low  currents, 
the  linear  polarization  curve  is  used  so  that  the  fuel  cell  voltage  can 
be  computed  as  a  function  of  fuel  cell  current  as  shown  below: 

VFc  =  Vfc.qc  -  ^fc^fc  (27) 

where  UFc.oc  denotes  the  voltage  at  a  fuel  cell  current  of  zero  (no¬ 
current  state),  and  ftFc  denotes  the  overall  fuel  cell  resistance  in  the 
Ohmic  loss  region  of  the  polarization  curve. 

Assuming  a  linear  polarization  curve  and  negligible  auxiliary 
power,  the  fuel  cell  current  can  be  described  as  a  function  of  fuel 
cell  power.  Then,  the  hydrogen  mass  flow  rate  can  be  expressed  as 
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quadratic  function  of  fuel  cell  power  by  taking  Taylor's  series 
approximation  at  Pfc, req  =  0  as  shown  below: 


M  MH2  t  hT  MH2  VPC  OC  ~  \^C- O^-^FcPFOreq 

Nfc1 ^/fc  =  Nk17T - Wc - 


Nfc- 


M 


H' 


1 


neF  I  1/pc  -oc 


PFC-req  + 


R 


FC 


V3 

Vpcoc 


Per 

1  FCreq 


(28) 


B.  Simplified  battery  model 

Assuming  the  battery  model  as  the  simple  resistive  equivalent 
circuit  model,  the  battery  power  loss  is  expressed  as  a  function  of 
battery  power  using  Ohm's  law,  and  then,  approximated  in  the 
same  way  as  in  the  previous  section: 

PbT  •  loss  =  RbtIIt 

(Vbt  OC  -  y^BT  OC-^BTPBT  reqj  ^ 

=  ~p2  PBTreq 

B1  vBT-OC 

(29) 


4.2. 1.2.  ECMS  cost  function  using  simplified  models.  For  solving  an 
ECMS  optimization  problem  analytically,  it  is  necessary  to  change 
original  cost  function  used  in  ECMS  to  quadratic  cost  function  using 
simplified  models.  ECMS  cost  function  representing  equivalent  fuel 
consumption  can  be  modified  as  quadratic  function  of  fuel  cell 
power,  as  expressed  in  Eq.  (30). 


d  gECMS 
0P2 

Ui  FC  req 


2(^2  +  5M3)  >  0 


(31) 


Since  the  model  parameters  of  power  sources  such  as  p2,g3  and  s 
are  always  positive,  quadratic  cost  function  must  have  a  minimum. 
The  necessary  condition  for  the  solution  to  be  the  minimum  is  that 
the  first-order  partial  derivative  of  the  ECMS  cost  function  must  be 
zero.  Using  this  necessary  condition,  the  analytic  expression  of  EF 
can  be  derived  as  shown  below. 


dgECMS  _  0=>sDp  =  Ml  +  2/X2 ^FC- DP 

apFc  •req  1  +  2/x3(Pdemand  -  Pfc  dp) 


(32) 


For  extracting  globally  optimal  EF  trajectory,  this  simple  analytic 
EF  formula  can  be  used  to  compute  EF  based  on  DP  results  without 
ECMS  database  built  a  priori.  For  this  reason,  this  algorithm  is 
computationally  efficient.  Furthermore,  since  this  formula  is 
defined  by  parameters  of  power  sources,  parameters  can  be  easily 
adjusted  when  the  characteristics  of  models  change. 


4.2.2.  Numerical  (map-based)  approach 

If  ECMS  is  implemented  with  EF  trajectory  obtained  from  the 
analytical  approach  introduced  in  the  previous  section,  ECMS  and 
DP  results  show  similar  trends  in  power  distribution  between  the 
two  power  sources.  However,  they  are  not  identical  due  to 
modeling  errors.  Therefore,  from  the  practicality  viewpoint,  the 
numerical  (map-based)  approach  based  on  ECMS  database  is  pre¬ 
sented.  Overall  Procedure  is  illustrated  in  Fig.  2.  First,  ECMS  data¬ 
base  is  built  by  iterative  optimization  process.  Then,  DP  results  are 
computed  by  DP  algorithm.  Optimal  EF  trajectory  is  extracted  from 
ECMS  database  and  DP  results  through  the  inverse  operation 
introduced  in  Eq.  (26). 
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(30) 


where,  fuel  cell  power  PFc.req  is  defined  as  the  control  input.  Two 
power  sources  must  provide  power  demand:  Pdemand  =  Pfc  req  + 
PBT-req* 

4.2.13.  Derivation  of  EF  formula  using  necessary  and  sufficient  con¬ 
ditions.  The  proposed  method  utilizes  all  of  the  optimal  solution 
obtained  from  DP,  which  includes  the  battery  SoC,  fuel  cell  power, 
and  power  demand.  As  explained  in  Section  3.1,  the  battery  SoC  and 
fuel  cell  power  computed  from  DP  stay  within  the  admissible  state 
and  control  input  range,  respectively.  Therefore,  this  problem  is 
treated  as  an  unconstrained  optimization  problem  with  ECMS  cost 
function,  and  use  necessary  and  sufficient  conditions  for  a  mini¬ 
mum  cost  function  to  derive  the  optimal  EF  formula.  Second-order 
partial  derivative  of  the  ECMS  cost  function  (the  sufficient  condi¬ 
tion)  is  derived  to  distinguish  between  a  minimum  and  a 
maximum,  as  follows: 


Fig.  2.  Numerical  approach  procedure. 
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Fig.  3.  ECMS  database:  optimal  ECMS  fuel  cell  power  as  a  function  of  the  battery  SoC,  power  demand,  and  EF. 


Respective  static  efficiency  maps  of  the  battery  and  fuel  cell 
system  are  used  to  define  nonlinear  ECMS  cost  function,  as 
expressed  in  Eq.  (33).  For  given  power  demand,  the  battery  SoC, 
iterative  optimization  process  using  this  cost  function  is  carried  out 
for  computing  optimal  fuel  cell  power.  Then,  computed  value  is 
stored  in  ECMS  database  as  a  map  function  of  three  variables;  the 
battery  SoC,  power  demand,  and  EF,  as  Fig.  3  shows. 

^U2  Pe  BT 

< - ^ - s  / - - s 

<§ECMS  =  ^H2'LHVh2  +5-  (PBT  +PbT-1oss) 

=  ^FCreq  ^BT-req 

VH2  (^FCreq)  ^BT  (^BT-req?  SoC) 

where,  t)H2  is  total  fuel  cell  system  efficiency,  and  tjbt  is  total  battery 
system  efficiency. 

As  in  the  previous  section,  DP  results  are  also  gathered  and  used 
to  make  the  inverse  operation  to  extract  optimal  EF.  In  ECMS 
database,  for  given  the  power  demand  and  the  battery  SoC,  optimal 
ECMS  fuel  cell  power  and  EF  also  have  one-to-one  relationship.  As 
last  step  of  numerical  (map-based)  approach,  therefore,  EF  corre¬ 
sponding  to  optimal  fuel  cell  power  obtained  from  DP  can  be 
searched  in  ECMS  database. 

In  this  study,  the  numerical  (map-based)  approach  is  chosen  to 
analyze  how  to  adjust  EF  corresponding  to  real-world  driving 
conditions,  as  a  part  of  designing  adaptation  laws  for  real-time 
ECMSs  when  the  battery  SoC  violates  its  maximum/minimum 
bound;  we  call  the  ECMS  with  DP-based  EF  as  DP-based  ECMS.  For 
example,  when  the  FCHEV  is  driving  on  a  hilly  road,  future  driving 
information  such  as  altitude  profile  should  be  used  to  properly 
adjust  the  EF  for  optimal  performance.  The  influence  of  altitude 
profile  on  the  general  trend  of  DP-based  ECMS  is  investigated  in 
depth  in  a  case  study  described  in  Section  5. 

5.  Case  study:  FCHEV  control  on  hilly  roads 


5.2.2.  Simulation  environment 

Two  case  studies,  a  downhill  road  with  a  slight  grade  and  a 
downhill  road  with  a  steep  grade,  have  been  demonstrated  in  order 
to  emphasize  the  impact  of  active  state  constraints  on  the  needs  for 
EF  adjustments.  Furthermore,  these  case  studies  provide  insights 
on  how  EF  should  be  adjusted  for  the  optimal  fuel  economy  when 
SoC  constraints  are  activated  by  the  hilly  road. 

The  simulation  test  cycle  was  modified  with  the  addition  of  the 
road  grade  profile  to  a  US  Federal  Test  Procedure  (FTP)-highway 
driving  cycle.  The  velocity  profiles  are  assumed  to  be  the  same  on 
two  hilly  roads.  As  shown  in  Fig.  4,  the  driver  power  demand  is 
offset  by  negative  power  demands  due  to  reduced  demand  when 
downhill  road  grades  are  present;  the  first  slight  downhill  road  is 
set  to  -10  kW  (roughly  -1.4°),  and  the  second  steep  downhill  road 
is  set  to  -26.6  kW  (roughly  -3.7°). 

The  maximum  SoC  bound  is  set  to  80%,  minimum  SoC  bound  is 
set  to  20%,  and  initial  battery  SoC  is  set  to  50%.  Namely,  the  ad¬ 
missible  SoC  range  is  set  to  20%-80%  in  order  to  ensure  a  long 
battery  cycle-life  while  maintaining  sufficient  battery  capacity  for 
the  recuperation  of  braking  energy.  When  the  SoC  reaches  the 
maximum  SoC  bound  during  braking,  the  supervisory  controller 
switches  from  regenerative  braking  into  conventional  mechanical 
braking  to  prevent  overcharging. 

Suppose  that  future  driving  information  can  be  known  a  priori, 
where  offline  iterative  search  determines  the  initial  values  of  EF  and 
costates  of  conventional  ECMS  and  PMP  for  satisfying  the  battery  SoC 
boundary  condition,  respectively.  Then,  the  comparative  analysis  of 
three  EMSs  for  two  hilly  road  conditions  is  performed  as  follows. 

5.2.2.  First  case:  light  downhill  road 

First  case  of  hilly  road  with  a  slight  grade  represents  the  normal 
driving  conditions  when  a  hilly  road  profile  does  not  lead  the 
battery  SoC  to  violate  any  SoC  bound.  In  Fig.  5,  the  blue  line  rep¬ 
resents  DP-based  ECMS  (ECMS  using  DP-based  EF;  see  Section 


This  section  consists  of  two  parts:  1 )  offline  study  on  three  EMSs 
(DP-based  ECMS,  PMP,  and  conventional  ECMS)  and  the  optimal  EF 
adjustment  under  two  hilly  road  conditions;  and  2)  the  evaluation 
of  real-time  EF  adaptation  law  designed  on  the  basis  of  DP-based  EF 
results. 

5.2.  Study  on  the  optimal  EF  adjustment  under  two  hilly  conditions 

Two  goals  of  this  subsection  are  as  follows:  first  one  is 
comparative  study  on  the  performance  of  three  EMSs  corre¬ 
sponding  to  hilly  roads,  and  the  second  one  is  analysis  on  how 
altitude  profile  influences  EF  trajectory  for  achieving  the  global 
optimality  while  satisfying  the  battery  charge-sustenance. 


Fig.  4.  Power  demand  profile  corresponding  to  different  hilly  road. 
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Fig.  5.  First  light  downhill  road  for  three  EMSs  (DP-based  ECMS,  PMP,  conventional  ECMS):  (a)  EF  trajectory  (b)  battery  SoC  trajectory  (c)  energy  histogram  of  fuel  cell  system.  (For 
interpretation  of  the  references  to  color  in  this  figure  legend,  the  reader  is  referred  to  the  web  version  of  this  article.) 


4.2.2),  red  dotted  line  represents  PMP  (see  Section  3.2),  and  the 
green  dash-dot  represents  conventional  ECMS  (see  Section  4.1.2). 
All  EMSs  have  the  same  constant  EF  value  (or  costate)  because  the 
variations  in  road  slope  are  not  large  enough  to  activate  the  state 
constraints  in  Fig.  5(a).  Note  that  the  costate  dynamics  of  PMP  can 
be  neglected  under  inactive  state  constraints.  Furthermore,  they 
generate  the  same  SoC  trajectory  within  the  admissible  SoC  range 
(Fig.  5(b)).  For  this  reason,  the  distribution  of  fuel  cell  power  re¬ 
mains  unchanged  with  various  EMSs  as  shown  in  Fig.  5(c).  There¬ 
fore,  under  a  light  downhill  road  condition,  state  constraints  are  no 
activated,  and  thus  all  EMSs  achieve  near-optimality  and  charge- 
sustenance  using  constant  EF  (costate). 

5.1.3.  Second  case:  steep  downhill  road 

Second  case  for  a  steep  downhill  road  represents  an  extreme 
driving  condition  in  which  hilly  road  profile  activates  the  state  con¬ 
straints.  As  shown  in  Fig.  6(a),  constant  EF  (costate)  no  longer  works, 
and  EF  needs  to  be  properly  adjusted  to  maximize  fuel  economy  while 
maintaining  charge-sustenance.  In  particular,  large  deviations  of  SoC 
and  EF  trajectories  between  conventional  ECMS,  PMP,  and  the  DP- 
based  ECMS  are  observed.  Since  the  penalty  function  of  conven¬ 
tional  ECMS  is  activated  when  the  battery  SoC  reaches  SoC  bounds,  it 
cannot  prepare  for  the  upcoming  hilly  road  in  advance,  and  thus  a  part 
of  the  recoverable  braking  energy  is  lost  (Fig.  6(b).  Consequently,  the 
fuel  cell  must  produce  more  energy  to  compensate  for  this  lost  en¬ 
ergy,  which  leads  to  the  loss  of  optimality  and  fuel  economy.  As  shown 
in  Figs.  6(c)  and  7,  fuel  cell  system  of  conventional  ECMS  operates 
more  often  at  medium  power  range  (20  kW-30  kW),  and  hydrogen 
consumption  increases  in  comparison  with  other  two  EMSs.  In 


contrast,  other  two  EMSs  discharge  the  battery  to  the  minimum  SoC 
bound  before  arriving  at  the  downhill  section.  Namely,  if  potential 
energy  of  an  upcoming  hilly  road  is  large  enough  to  violate  the 
maximum/minimum  SoC  bound,  EF  should  be  adjusted  accordingly 
before  driving  into  a  hilly  section. 

Since  the  first  PMP  costate  equation  changes  dramatically  under 
active  state  constraints,  the  fuel  economy  and  EF  trajectory  of  PMP 
are  very  similar  to  those  of  the  DP-based  ECMS,  which  is  the  global 
optimal  solution.  However,  PMP  only  provides  the  necessary  con¬ 
ditions  for  optimal  solutions  and  has  multiple  local  minimum  when 
the  state  constraints  are  active.  Among  them,  the  best  solution  that 
gives  global  minimum  hydrogen  consumption  is  chosen,  and  it  is 
used  for  final  comparison  in  Figs.  6  and  7.  As  Fig.  8  and  Table  2  show, 
there  exist  many  PMP  cases  which  have  local  minimum.  Note  that 
iterative  optimization  process  is  needed  to  find  initial  costates 
which  leads  to  one  of  the  multiple  local  minimum.  For  this  reason, 
the  procedure  of  PMP  for  finding  global  minimum  is  inconvenient 
and  time  consuming.  Conclusively,  DP-based  EF  computed  from  the 
proposed  method  is  considered  as  promising  benchmark  for  design 
of  adaptation  law  corresponding  to  various  hilly  road  conditions. 

5.2.  Development  of  a  real-time  EF  adaptation  strategy  for  hilly 
roads 

52.1.  DP-based  EF  trajectory  analysis 

In  addition  to  the  two  hilly  road  conditions  described  in  Section 

5.1.1,  a  medium  downhill  road  is  supplemented  to  obtain  more 
detailed  trends  on  how  DP-based  EF  trajectories  vary  over  several 
hilly  road  conditions.  The  medium  downhill  road  is  set  to  -20  kW 


J.  Han  et  al.  /  Journal  of  Power  Sources  267  (2014)  491—502 


499 


Steep  downhill  road 


°  DP-based  ECMS 

- PMP  w/  state  constraint 

.....  ECMS  w/  state  constraint 


2  4  6  8  10  12  14  16  18 

Distance  [km] 


Steep  downhill  road 


Steep  downhill  road 


Fig.  6.  Second  steep  downhill  road  for  three  EMSs  (DP-based  ECMS,  PMP,  conventional  ECMS):  (a)  EF  trajectory  (b)  battery  SoC  trajectory  (c)  energy  histogram  of  fuel  cell  system. 


(roughly  -2.8°),  and  driver  power  demands  for  all  hilly  roads  are 
shown  in  Fig.  9.  Uphill  road  conditions  are  excluded  in  this  paper 
because  the  effect  of  uphill  information  on  fuel  economy  improve¬ 
ment  is  relatively  small  [28,29  .  Fig.  10  shows  that  the  optimal  EF  is 
held  constant  as  long  as  the  SoC  boundary  constraint  is  inactive.  The 
value  of  constant  EF,  however,  varies  with  the  road  grade.  On  the 
other  hand,  when  steep  downhill  conditions  activate  the  SoC 
constraint,  EF  must  be  adjusted  for  optimal  fuel  economy  as  well  as 
charge-sustenance. 

5.2.2.  EF  adaptation  algorithm 

Based  on  the  analysis  of  DP-based  EF  trajectories,  a  real-time  EF 
adaptation  algorithm  is  proposed  as  follows.  The  proposed  algo¬ 
rithm  consists  of  two  parts:  static  EF  adaptation  algorithm,  dynamic 
EF  adaptation  algorithm.  The  static  algorithm  normally  adjusts  EF 


over  light  hilly  road  conditions,  but  the  dynamic  algorithm  is 
activated  when  the  state  inequality  constraints  become  active, 
which  can  be  determined  by  the  potential  energy  of  the  hilly  road, 
i.e.,  when  the  potential  energy  exceeds  the  half  of  battery  energy 
capacity.  In  order  to  determine  whether  potential  energy  exceeds 
the  half  of  battery  energy  capacity,  future  driving  information  such 
as  road  slope  profile  and  average  velocity  are  necessary.  This  in¬ 
formation  enables  the  estimation  of  average  power  demand  by 
using  Eq.  (6),  and  can  be  obtained  from  map  database  in  Global 
Positioning  System  (GPS)  navigation  system. 

A.  Static  EF  adaptation  algorithm 

The  static  EF  adaptation  algorithm  is  developed  based  on  an  EF 
sensitivity  analysis.  Since  the  power  demand  varies  under  hilly  road 
conditions  due  to  gravitational  force,  a  nominal  EF  designed  for  a 
flat  road  would  lead  to  biases  in  battery  power  and  SoC.  Therefore, 
an  EF  adaptation  algorithm  is  proposed  to  cancel  out  this  battery 
power  variation  with  respect  to  the  power  demand  variation. 
Namely,  one  can  find  the  EF  variation  that  is  necessary  to  cancel  out 
the  bias  in  optimal  battery  power  due  to  the  road  grade  from  the 
following  equality  equation. 


v*  demand 


'0Pi 


BT ■ req 

ds 


(34) 


Fig.  7.  Increase  in  H2  mass  consumption  [%]  compared  to  DP-based  ECMS:  final  H2 
consumption  of  DP-based  ECMS  is  considered  reference  to  calculate  increased  amount 
of  H2  consumption  of  other  EMSs  under  two  hilly  road  conditions. 


where  A 

v  BT-req 


APdemand 


is  the  expected  optimal  battery  power  vari¬ 


ation  corresponding  to  the  power  demand  variation,  APgT. 


req 


As 


IS 


500 


J.  Han  et  al.  /  Journal  of  Power  Sources  267  (2014)  491—502 


Steep  downhill  road  Steep  downhill  road 


Fig.  8.  Several  PMP  cases  on  second  steep  downhill  road:  (a)  battery  SoC  trajectory,  (b)  EF  (costate)  trajectory. 


Table  2 

Initial  costates  and  final  H2  mass  consumption  of  PMP  on  second  steep  downhill 
road. 


Second  steep  downhill  road 

PMP  case  1 

PMP  case  2 

PMP  case  3  PMP  case  4 

Ai(to) 

0.0353 

-0.0263 

-0.0275  -0.0219 

^2(fo) 

-3.167e”4 

-0.0498 

-0.0796  -0.0526 

H2  mass  [g] 

82.7 

78.6 

88.3  95.0 

the  expected  optimal  battery  power  variation  corresponding  to  the 
EF  variation,  9PgT.req/aPdemand  is  the  optimal  battery  power  sensi¬ 
tivity  to  the  power  demand  variation,  9PBT.req/9s  t^e  optimal 

battery  power  sensitivity  to  the  EF  variation,  and  APdemand  is  the 
average  power  demand  variation.  Fig.  11(b)  illustrates  the  sensi¬ 
tivity  of  the  optimal  EF  with  respect  to  the  power  demand  variation. 
Herein,  EF  slope  is  determined  by  model  parameters  of  fuel  cell 
system  and  battery  system.  Readers  are  referred  to  [30]  for  more 
details. 

B.  Dynamic  EF  adaptation  algorithm 

The  dynamic  EF  adaptation  algorithm  is  designed  based  on  the 
necessary  condition  for  steep  downhill  road.  In  such  case,  the  EF 
must  be  adjusted  to  compensate  for  the  upcoming  road  grades 
because  the  potential  energy  is  large  enough  to  activate  the  state 
inequality  constraints.  For  instance,  the  battery  SoC  should  be 
depleted  to  minimum  before  arriving  at  the  severely  downhill 
section  so  that  the  battery  can  recharge  the  large  potential  energy 


as  much  as  it  can  during  the  downhill  section.  After  that,  the 
maximum  SoC  should  be  depleted  to  desired  SoC  (initial  SoC  value) 
at  destination.  Therefore,  each  EF  can  be  computed  by  solving  Eq. 
(32).  That  is, 

s~f(P demand* Pbt)  where  PBT  =  B^lim,g  (35) 

where  Pdemand  denotes  the  sectional  average  power  demand,  PBt 
denotes  the  sectional  desired  battery  power,  v  denotes  sectional 
average  velocity,  FBT.lim  denotes  battery  energy  capacity,  and  d  de¬ 
notes  driving  distance  for  each  road  section.  Note  that  the  future 
road  grade  is  assumed  known  a  priori  in  this  study,  and  the  road  is 
divided  into  several  sections  by  the  road  grade. 

5.2.3.  Performance  evaluation:  charge-sustenance  and  fuel 
economy 

In  this  section,  the  charge-sustenance  and  fuel  economy  per¬ 
formance  of  the  proposed  EF  adaptation  strategy  is  evaluated  via 
simulation.  Three  target  hilly  roads,  light,  medium,  and  steep 
downhill  road,  are  employed  for  the  evaluation.  Note  that  only  the 
steep  downhill  road  has  potential  energy  large  enough  to  activate 
the  SoC  constraint,  and  the  nominal  EF  is  computed  based  on  the 
flat  road. 

The  fuel  economies  of  three  control  strategies  (DP-based  EF,  no 
EF  adaptation,  and  proposed  EF  adaptation  algorithm)  are  sum¬ 
marized  for  three  levels  of  downhill  road  conditions  in  Fig.  12.  Note 
that  the  fuel  economy  of  each  strategy  is  normalized  by  the  DP  fuel 
economy  with  the  corresponding  SoC  for  a  fair  comparison.  As 
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Fig.  9.  Power  demand  profile:  flat  road,  light  downhill  road,  medium  downhill  road, 
and  steep  downhill  road. 


Fig.  10.  DP-based  EF  trajectories  for  several  hilly  road  conditions:  flat  road,  light 
downhill  road,  medium  downhill  road,  and  steep  downhill  road. 
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Fig.  11.  (a)  Classification  of  region  for  EF  adaptation  strategy  (b)  Static  EF  adaptation. 
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Fig.  12.  Comparison  of  fuel  economy  performance:  all  fuel  economy  is  normalized  by 
DP  fuel  economy  with  the  matching  final  SoC. 
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shown  in  Fig.  12,  the  proposed  EF  adaptation  algorithm  achieves 
near-DP  fuel  economy  (less  than  3%  loss)  while  the  ECMS  without 
EF  adaptation  results  in  losses  of  fuel  economy  up  to  15%.  Fig.  13 
illustrates  that  with  increasing  downhill  road  grade,  both  EF  and 
SoC  trajectories  of  the  ECMS  without  EF  adaptation  start  to  deviate 
from  those  of  the  DP-based  EF  solution,  which  implies  the  loss  of 
fuel  economy  and  charge-sustenance.  The  loss  of  optimality  is  more 
pronounced  for  the  steep  downhill  road  case  because  the  SoC 
constraint  becomes  active  and  the  entire  potential  energy  cannot 
be  recuperated.  The  proposed  EF  adaptation  algorithm,  however, 
adjusts  EF  according  to  the  road  grade  in  order  to  compensate  for 
the  change  in  power  demand  as  well  as  to  prepare  for  the 
maximum  recuperation  of  large  potential  energy  available  from  the 
steep  downhill  road.  These  EF  adjustments  result  in  near-DP  fuel 
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Fig.  13.  Comparison  of  SoC  and  EF  trajectories:  (a)  light  downhill  road,  (b)  medium  downhill  road,  (c)  steep  downhill  road. 
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economy  and  charge-sustenance  performance  for  various  hilly  road 
conditions. 

6.  Conclusion 

This  paper  proposes  a  method  for  extracting  a  globally  optimal 
EF  trajectory  from  the  DP  results  as  a  benchmark  for  design  of  EF 
adaptation  law.  When  the  state  inequality  constraints  are  active, 
the  DP-based  ECMS  approach  has  an  advantage  over  the  PMP 
approach  because  the  latter  yields  multiple  minimum  solutions, 
and  requires  an  iterative  process  to  find  the  solution  with  the 
minimum  cost.  The  extracted  EF  trajectory  of  DP-based  ECMS 
represents  the  proper  EF  adjustment  on  hilly  roads.  A  comparison 
of  the  DP-based  ECMS'  results  with  those  of  the  PMP  and  the 
conventional  ECMS  shows  that  when  hilly  road  conditions  do  not 
affect  the  SoC  inequality  constraints,  the  EF  trajectories  of  all 
EMSs  (DP-based  ECMS,  PMP,  and  conventional  ECMS)  are  con¬ 
stant  and  almost  the  same.  In  contrast,  when  hilly  road  conditions 
activate  the  SoC  inequality  constraints,  EF  must  be  changed 
considerably  for  the  optimal  fuel  economy;  otherwise,  the  loss  of 
optimality  is  significant.  Therefore,  the  DP-based  EF  should  pro¬ 
vide  useful  insights  and  can  be  used  to  design  an  EF  adaptation 
law  as  well  as  a  benchmark.  As  an  example,  a  real-time  EF 
adaptation  law  is  designed  and  evaluated  over  several  hilly  roads. 
Results  show  that  it  achieves  superior  fuel  economy  over  the 
ECMS  without  EF  adaptation.  In  fact,  near-optimal  performance 
was  observed  while  maintaining  the  charge-sustenance.  Future 
works  include  the  improvement  of  the  EF  adaptation  law  for 
robust  performance  even  with  inaccurate  future  driving 
information. 
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Appendix 


Relationship  between  DP  and  PMP  without  constraints. 

PMP  can  be  derived  from  DP  in  continuous  time  in  the  case  that 
there  are  no  state  constraints.  Thus,  this  section  deals  with  the 
interpretation  of  costate  of  PMP  by  analyzing  of  the  relationship 
between  DP  and  PMP.  With  DP,  in  continuous  time,  it  is  possible  to 
obtain  the  sufficient  condition  by  using  the  principle  of  optimality. 
This  approach  leads  to  a  nonlinear  partial  differential  equation  by 
using  the  principle  of  optimality  called  the  Hamil- 
ton-Jacobi-Bellman  (HJB)  equation  21],  as  follows: 


-Jt  (x,  t)  =  min{g(x,u,  t)  + 

UGti  t 


;*(x,  t)lTf(x,u, 


where  /(x(t),t)  is  the  optimal  cost-to-go  function  from  time  t  to 
final  time  tf.  J[  and  J*  are  partial  derivatives  of /(x(t),t)  with  respect 
to  t  and  x. 

The  HJB  equation  is  considered  as  both  a  necessary  and  a  suf¬ 
ficient  condition  for  optimality.  The  derivation  of  PMP  from  the  HJB 
equation  is  given  in  Ref.  [21  .  In  conclusion,  the  final  formula  ob¬ 
tained  using  the  HJB  equation  is  expressed  under  the  condition  that 
no  state  is  not  constrained  by  any  boundary,  as  follows: 


tf/*(x*,t)_  (dg(x*,U*,t)\T  (df(x*,U*,t)\T A 

dt  -  (  dx  J  (  0x  JMX.rj 


where  the  optimal  control  u*{t )  satisfies 


g(x  ,U 


0+  £(*V) 


Tf(x,u,t) 


min{g(x*,u,t)  + 

UGti  t 


Jx(x*,f)  f(x*,u  ,t) 


and  the  boundary  condition 

Jx  (x*  (tf) ,  tf )  = 

As  is  evident  from  the  above  equation  and  boundary  condition, 
7*  and  the  optimal  costate  A*  of  PMP  satisfy  the  same  differential 
equation  and  have  the  same  boundary  conditions;  therefore,  the 
optimal  costate  of  PMP  corresponds  to  the  partial  derivative  of  the 
optimal  cost  function  with  respect  to  x  when  the  state  constraints 
do  not  exist. 

x*(t)=;*(x*,t) 

This  is  assuming  that  the  mixed  partial  derivatives  are 
continuous. 
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